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DESCRIPTION 

Field of the invention 

The invention relates to a viewing system, comprising acquisition means for 
5 acquiring a sequence of Images, detection means for detecttng an object of interest In said 
sequence of Images, and viewing means for displaying said sequence of Images. The 
invention also relates to a method to be used In said system. The Invention further relates to 
a medical examination apparatus coupled to such a system. 

The Invention finds for example its application In medical Imaging systems, for 
10 detecting objects of Interests such as stents and arisry walls in angiograms. 

Domain of the invention 

A method for detecting stents in medical images Is already known from the 
publication entitled "Deformabie Boundary Detection of Stents In Angiographic Images", by 
15 loannis Kompatsiaris et alll. in IEEE Transactions on Medical Imaging, Vol. 19, no 6, June 

2000, pages 652-662. This document describes an image processing method for defonraWe 
boundary detection of medical tools, called stents. In angiographic Images. 

A stenosis Is a narrowing of a blood vessel. When a stenosis Is Identified In a 
coronary artery of a patient, a procedure called angioplasty or Percutaneous Transluminal 
20 coronary Angioplasty (PTCA) may be prescribed. A basic idea of VTC^ Is to position a 

monorBlI with a small Inflatable balloon within a narrowed section of an artery. The balloon 
Is Inflated in order to push outwards against the wall of the nan-owed artery. This process 
reduces the nanowing until It no longer interferes with the blood flow. The balloon Is then 
deflated and removed froin the artsry. In order to avoid re-stenosIs to occur, said process is 
25 often followed by a stent Implantation. A stent is a surgical stainless steel coil that Is 

Introduced In the artery on another balloon monorail. The stent is wrapped tightly around 
tine balloon attached to the monorail. Said balloon tipped monorail Is Introduced into Ihe 
artery. The inflation of tiie balloon causes ttie stent to expand, pressing it against the artery 
wall. The stent, once expanded, can be considered as a permanent Implant, which ads like 
30 a scaffold keeping the artery wall open and allowing normal blood ftow to occur through tiie 
artery. Stent placement helps many patients avoid enfiergency heart: bypass and/or heart: 
attack. 

A key step of said procedure Is to check whetiier tiie stent has been placed at the 
right position of the stenosis and whetiier It has been successfully expanded. As a matisr of 
35 foct, dlnlcal problems are assodated witii inadequate placement or expansion of the stent 
Inadequately expanded stents can locally dlsropt blood flow and cause thrombosis. 



1 

4 



During a PTCA It Is possible to observe In real time the area of the stenosis on a 
sequence of angiographic (mageS/ but the precise stent placement Is not easily visible due to 
several reasons: 

- the Image sequence Is rather noisy and Its contrast Is low due to the use of a 
5 low X-Ray dose, 

. the stent location changes all along the Image sequence due to the Influence of 
cardiac pulses and patients breathing. 
Studies revealed that consequently more than eighty per cent of stents might be 
Insuffldently dilated despite an apparently successful deployment on the sequence of 
10 angiographic images. Automatically detecBng the stent border could therefore help obtain a 
more precise checking of the stent placement. 

The method that Is disclosed in the cited publication relies on the Identification of 
the stent In the angiographic Images. It comprises steps of: 

- forming 3D models of stents, 

15 . deriving a set of 2D models using perspective rules, 

- matching said 2D models with real angiographic Images In a training phase, 

- roughly detecting a stent In an angiographic Image using the set of 2D models 
and maximum of likelihood criteria, 

- refining the borders of tiie roughly detected stent using an active contour 
20 model. 

A drawback of said metiiod Is to present a calculation load tfiat Is actually too heavy 
for real time processing of a sequence of Images In the Intervention phase of stent 
implantation. 

25 

Summary of the Invention 

An object of the invention is to propose a less complex solution to detect the 
borders of an object of Interest in a sequence of noisy images. 

A viewing system according to the Invention and as described In the opening 
30 paragraph comprises acquldtion means for acquiring a sequence of Images, detection 
means for detecting an object of Interest in said sequence of Images, 
said detection means compridng: 

- localizer detection sub-means for detecting a location of localizers related to 
said object of Interest, 

35 - border detection sub-means for detecting a location of borders related to 

said object of Interest, 
and viewing means for displaying said sequence of Images. 



The viewing system according to the invention comprises detecUon means for 
indirectly detecting the borders of the ol^Ject of Interest. To this end, said detection means 
comprise localizer detection sub-means, which are Intended to search for localizers Instead 
of searching for the object of Interest. An advantage is that kxaDzers have been espedaUy 
5 designed for being visible In an angiographic Image: they are simply shaped o^ects made of 
radio-opaque material, unlllce for example a stent or a stenosis, which have a low contrast 
and a complex shape. Consequently said localizers can be detected easily without involving 
complex models. 

The detection means further comprise border detertlon sub-means, which are 
10 intended to find the borders of the object of Interest as the most salient borders including 
said locallzere. During a procedure of stent placement for instance, the stent borders are 
usually more visible than the borders of the cxjronary artery. When the artery borders are 
searched for, some contrast agent may be injected, in order to enhance them. 

Therefore, the detection means according to the Invention have a low complexity 
15 that allows their Implementation In real time. 

The viewing system accoitllng to the Invention fUrther comprises enhancement 
means for enhancing the border of the ol^ject of Interest using the location of said borders 
and delivering an enhanced sequence of Images. The knowledge of said tocation allows an 
outstanding enhancement of the contour of the ol>Ject of interest In the domain of 
20 angiography, such an outstanding enhancement may help check the stent position and 
deployment 

The viewing system according to the invention further comprises measurement 
means for measuring characteristics of said object of Interest using said location of borders. 
An advantage of said characteristics, which are for Instance different widths of the object of 

25 Interest along Its length, is that they can be used for ol^ectlvely evaluate for Instance the 
severity of a stenosis or its reduction by a stent 

The viewing system according to the Invention further comprises three dlmenstonal 
(3D) representation means for representing said object of Interest in three dimensions. An 
advantage Is that said 3D representation Is easily obtained from said object borders and 

30 some a priori knowledge of this object. A 3D representation of a tobular object of Interest 
like a stent or a stenosis may for Instance be derived from the knowledge of its border 
location In two views and the assumption of a cylindrical shape with a variable elliptic 
section. 

35 Brief description of the drawings 

The Invention will be further desalbed with reference to the accompanying 

drawings: 



Rgs la, lb, 2a and 2b Illustrate two steps of angioplasty: during balloon Inflation 
and then during stent deployment at the location of a stenosis, 

Rg. 3 Is a functional block diagram of the detection means according tx> the | 
Invention, > 
Rg.4a Is a functional block diagram of the localizer detection sub-means according 
to the invention, ^ 
Rg. 4b shows a circular filter for extracting balloon markers according to the i 
invention, ^ 
Rg. 5 Is a functional block diagram of the marker extraction sub-means according to 
the Invention, 

- Rg. 6a shows an original angiogram, Rg. 6b shows two zones of detected markers and Rg. 6c 
shows an enhanced object of Interest on a filtered backgnDund, 

Rg. 7a and 7b Illustrate possible Initializations of an active contour according to the 
Invention, 

Rg. 8a and Rg. 8b shows how an active contour is inflated to match the borders of 
an ot>)ect of Interest 

- Rg. 9 shows ttiree possible applications of detecting the bonders of an object of Interest, whlcF 
are: an object enhancement;, a measurement of characteristics of the object of Interest and a 
3D representation of the object of Interest, 

- Rg. 10 shows a simple 3D model for building a 3D representation of a tubular object of Interes 
like a stent or an artery, 

- Rg. 11 is a functional block diagram of a medical examination apparatus using the system of 
the Invention. 

Detailed description of the invention 

The Invention relates to a viewing system, and to a method that is used to actuate 
the viewing system, for detecting borders of an object of Interest In real time In a sequence 
of noisy Images; The viewing system and the method of the invention are described 
hereafter as a matter of example In an application to the medical field of cardiology. In said 
application, the object of Interest Is an organ such as an artery or a t»ol such as a balloon 
or a stent. These objects are obsen^ed during a medical Intervention called angioplasty or 
PTCA, In a sequence of X-ray fluoroscopic Images called angiogram. 

It Is to be noted that the system and method may be applied to any other object of 
Interest than a stent or an artery In other images than angiograms. 

Referring to Rgs la to 2b, In the application described hereafter, the stent 
Implantation is a medical Intervention that usually comprises several steps for enlarging an 
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artery at the location of a lesion called stenosis. In a preliminary step, the practitioner 
localizes a stenosis 2 on a patient's artery 1 In the sequence of Images. In a first phase. 
Illustrated by Rg. la, he Introduces a thin guide-wire 3 through the lumen of the artery 1 
using a catheter 4. Said guide-wire 3 Is extended beyond the stenosis 2. It is to be noted 
that said guide-wire 3 has a radio-opaque tip 9 at Its ©rtremlty, which helps the jMactltioner 
check on a sequence of Images whether the guide-wire 3 Is well Introduced. A thin tube 5 
called a monorail is then easily slipped onto the guide-wire 3 and placed In the stenosis 
area. Said monorail 5 has a balloon 6 wrapped around it Said balloon 6 has two radio- 
opaque balloon markers 7 and 8 that help tine practitioner place the balloon 6 In the right 
position wltti respect to tiie stenosis 2. The balloon 6 Is then Inflated witii a high pressure as 
shown In Rg. lb, to become an Inflated balloon 10, In order to force the artery open. Once 
the practitioner has checked tiiat the stenosis 2 has been well reduced, the Inflated balloon 
10 Is deflated so as to let the blood flow and the monorail 5 is removed from the artery 2. 

In a second phase illustrated by Rgs 2a and 2b, another monorail 11 Is introduced 
Into the lumen of the artery 1. Said monorail 11 also has a balloon 12 wrapped around it; 
with two balloon markers 13 and 14, but In addition a stent 15 put over said balloon 12. 
The balloon 12 is Inflated to become an Inflated baitoon 16 and in order to expand the stent 
15, which becomes an expanded stent 17. Then, considering the expanded stent 17 as a 
pemianent Implant, the Inflated balloon 16, ttie monorail 11, tiie gukle-wire 3 and ttie 
catheter 4 are removed. 

It should be noted that the first phase is not compulsory, but often performed by 
practitionere for previously checking whetiier it Is possible to enlarge the artery before 
Introducing the stent. 

As mentioned above, a key point of the Intervention Is to place the stent properly In 
the stenosis area. To tills end, the practitioner visualizes tine area of the stenosis In real 
time on a sequent of Images several times during the Intervention. 

According to the Invention, the viewing system comprises detecting means for 
detecting an object of interest in said sequence of images. As shown by tiie functional 
diagram of Rg. 3, said detecting means 20 comprise localizer detection sub-means 30 for 
detecting a location of localizers related to said object of Interest and border detection sub- 
means 60 for detecting a location of borders related to said object of Interest A sequence of 
images IS is presented to said detecting means 20. For an image lo of said sequence IS, said 
localizer detection sub-means 30 search for localizers related to the object of Interest SaM 
localizers may have various shapes and be located Inside or outside the object of interest 

In a preferred embodiment of tiie invention tiie object of Interest is a stent or a 
stenods. The problem is that such an object of Intered: Is a hardly radio-opaque object of 
interest, vtfhich is moving on a moving background. Therefore, the stent or the stenosis Is 
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preferably detected IndlrecUy by locating related balloon martcers. Said balloon markers are 
disposed at each extremity of the balloon. The balloon-markers are particularly recognizable 
because they constitute punctual zones, practically black or at least dark In tiie angiographic 
Images. They are also very similar In shape. Referring to Rg. 4a, the localizer detection sub- 
means 30 comprise maricer extraction sub-means 40, which perfomi elementary measures 
for extracting candidates of mariners and fomjlng candidates of couples of markers. 

It Is to be noted that otiier types of localizers may be used for detection of stent or 
artery borders. Some stents have their own stent maricers, which are located on their 
borders. The tip of tiie guide wire shown In Figs la to 2b could also be considered as a 
single localizer for stenosis border detection during the procedure of tip placement. As a 
matt:er of feet, said tip, which marks the extremity of tine guide-wire, also Indicates whetiier 
tiie guide-wire has passed tiie stenosis area or not. Such a procedure of tip placement is 
rattier critical becau^ of tiie artery narrowing. Therefore, tiie detection of the stenosis 
borders during said procedure may help the practitioner pass tiie guide wire corredly 
through tiie stenosis. Said tip may be detected using ridge enhancement filtering means 
followed by thresholding means and skeletonization means. 

In tiie prefen^d embodiment of the Invention, tiie localizers are balloon markers. 
Refening to Fig. 5, tiie marico- extraction sub-means 40 comprise several elementary 
measure sub-means, which are Intended to characterize tiie candidates of mari<ers: 

Fjp;: ^- f^easure mmns 41 that select punctual darit zones contrasting on a 
brighter background: This measure Is provided by filter means, denoted by Fo- In a preferred 
example, referring to Rg. 4b, an appropriate filter comprises three circular concentric zones. 
Including a central zone CZ, a dead zone DZ and a peripheral zone PZ. The filter Fo Is furtiier 
divided into n sectoral zones SZ covering 360* and numbered 1 to n. A current sectoral zone 
Zk is numbered k wltii 1 ^ k ^ n. The first measure consists In scanning a cun-ent Image of 
the sequence of Images in order to look for a punctual dark zone, A punctual dark zone can 
be detected when said punctual dark zone is centered in ttie filter. When a punctual dark 
zone Is centered, it occupies tiie central zone CZ of tiie filter, and It occupies possibly a part 
of tiie dead zone DZ. The first measure Is based on tiw estimation of contra^ of Intensity 
between tiie cental zone CZ and the peripheral zone PZ. Said estimation of contrast may be 
can-led out by estimating the difference of tiie average of intensities b«ween tiie central 
zone CZ and peripheral zone PZ. This simple measure would conduct to a linear estimation of 
tiie contrast In order to refine tiie result of tills estimation, the first measure Is actually 
can-led out by calculating the minimum of the n averages of Intensities detennlned In the n 
peripheral sectoral zones separately. These minimum of Intensities are denoted by: 
Ipk = average of Intensity In the peripheral sectoral zone numbered k, 
and 1(2 « av^age of intensities In the central zone CZ. 



The final measure provided by the filter Fo Is: Ifo = nun (IpO - Icz 

This mrasure Ifo Is determined by scanning each pixel of the original Image lo 
with the filter Fo. It provides an enhanced Image, denoted by IZl, of punctual dark zones, 
denoted by Z, where all other structures have disappeared, to the exception of said 
punctual dark zones that are now candidates to constitute markers. 

tsamnd meaqirft means 42 comprising histogram means denoted by H: In this 
Image El, each pixel has a gray level. From the image IZl, an histogram Is constructed, 
which represents the different numbers H of pixels corresponding to each gray level value 
G. Toward the right of the axis G in Rg. 5, are the high gray level values; and toward the 
left of axis G are the low gray level values. FOr each gray level value 6, the height H of the 
box represents the number of pixels to be found having said gray level value. Since the 
average size of a punctual dark zones Z Is determined by the characteristics of the filter Fo, 
It is possible to estimate the size of a punctual zone In pixels. Assuming that the size of a 
punctual zone Is p pixels, and assuming that for example a number z of zones Is to be found 
In the Image El, It Is searched a number of p.z (p times z) pixels that have the highest 
gray levels. The histogram H, as shown In Rg. 5, penrlts of accumulating the number of 
pixels m adjacent boxes, starting fixim the right of axis G, until the estimated number of p.z 
pixels Is reached for the Image, i.e. for z zones of each p pixels, while choosing the p.z 
pixels having the highest gray levels I. e. the pixels in the boxes on the right of the G axis. 
The histogram H permits of determining a gray level Gh, which yields the p.z pixels. 

Third measure means 43 comprising threshold means denoted by Ti: A first 
Intensity threshold Ti Is then applied to the image El. The threshold Ti Is chosen equal to 
the previously detemilned gray level Gh. That pemnlts of selecting In the Image IZl said 
number p.z of pixels having at least a gray level equal to Gh. A new litege is fonned virttere 
the Intensities and the coordinates of the pixels are known, thus forming the Image of 
points IZ2. 

Frtiirth measur*> means 44. ca llpri label means, which perfomi a connexlty analysis 
on pbceis previously selectal for the Image E2, in order to connect pixels pertaining to a 
same punctual daric zone Z. The labeling means 44 provide a number of labeled punctual 
dark zones in a new image IZ3. 

Hflti measure means 45 comprising second threshold means T2: This second 
threshold Tz is applied for example on the intensities of the pixels of the Image IZ3 of 
labeled zones and on the diameter of the zones In order to select the best labeled zones. 
For example T2 equals a product of a given Intensity by a given diameter, for selecting a 
number of remaining punctual zones having the highest intensities and the best shapes for 
constituting markers, thus yielding an image of mari<ers E4. 
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Sixth measure means 46 using a table, denoted by CT: This table CT of possible 
couples CI, C2,... of selected punctual dark zones Is constructed based on the a-priorl 
known distance IM between the markers, with an IncerUtude of for example 20 %. TTie 
table CT provides an Image IC of the possible marker couples CI, C2,... 

Refen-lng to Fig. 4a, and based on the Image IC of possible marker couples, the 
localizer d^BcHon sub-means 30 ftirtiier comprise couple extracOon sub-means 50 for 
exb^cOng the best couple of markers based on crlterlons among which: 

ft rriterion of distance : the distance between the markers of the best couple must 
be very near the a-prlorl known distance IM with a given Incertitude. 

ft rriterinn of strength : the strength of the best couple must be larger than the 
strength of the other couples. The strength of a given couple may be detemilned as the 
average of enhanced Intensities yielded by filter Fo. 

ft q-ii-Prinn of similarity : the markers of the best couple must be very similar 
structures. The similarity of the markers of possible couples is detemiined- Once the 
punctual dark zones Z of p pixels are determined, their centrolds are calculated. Small 
Regions Of Interest, denoted by ROI are defined around each centrold, as represented by 
white squares in Fig. 6b. For each possible couple, correlation Is calculated between the 
corresponding ROIs. Strong oonrelatlon Is an Indication that the two strongly conflated ROIs 
con«spond to the markers of a couple of markers. 

A rriterton of mnHnuous track : The markers of a couple are can-led by a monorail, 
which Is guided by a guide-wire. The guide-wire is more or less visible. However, It may be 
enhanced by a ridge filter. So, If the markers of a possible couple are situated on a track 
corresponding to a ridge Joining tiiem, this constitutes an other indication that the two 
zones located at the extremities of the continuous track correspond to a couple of markers. 
Such a continuous track may be qualified by estimating the average ridgeness along the 
path joining the two zones. The measure of average ridgeness must provide a track that 
has a shape as near as the shape of a segment or of a parabola as possible. 

The detection of a continuous track connecting the couple of markers may be 
perfomied using a fast marching technique. This technique, well known to those skilled in 
the art:, first attributes a cost to the pb«ls located In a neighborhood of the couple of 
markers. Said cost Is for Instance Inversely proportional to the above calculated ridgeness. 
Said technique further fornis a path behween both markers, whteh minimizes a total cost In 
a graph made of the pixels of said neighborhood. In the foflowlng, said conOnuous track will 
be called an Inter-marker line IML It Is to be noted that the guide wire is present on a large 
portion of the artery and that consequently the Inter-marker line may be detected beyond 
the markers. 
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f\ r riterion of motion ; The markers being In the coronary artery are moving rapidly 
with respect to the cardiac pulses. False alarms, that Is darl< punctual zones that pertain to 
the background, are moving much more slowly with the patients breathing. In order to 
eliminate these possible false alanns, a temporal difference is perfbrnned between two 
5 succeeding images of the sequence. This difference provides a measure of temporal 

contrast The measure of temporal contrast permits of detecting the dark punctual zones 
showing an Important temporal contrast This measure is also an indication of possible 
couple of markere, since false alarms have a feebler temporal confrast 

All the above-desalbed criterlons are combined using a fuzzy logic technique for 
10 deriving a composite measure. The higher the composite measure is, the higher is the 

probability of the presence of a couple of marker. The highest composite measure pennlts 
of selecting the best couple of markers from the image of couples IC issued from the 
marker extraction means 1. The coordinates of said markers denoted by (U, Lz) in Fig. 4a 
and the coordinates of the pixels fonning the Inter-marker line II^IL are output. 
15 Rg. 6a shows an original Image of a medical sequence representing a catheter, a 

guide wire, a balloon with balloon-markers (as two small dark points) and an artery on a 
background of other organs. The visualization of the objects of interest (balloon and artery) 
Is very difficult Even the balloon-markers are hardly visible. Rg. 6b shows the original 
image with zones delimited In white, which are for the detennination of the punctual dark 
20 zones. In Rg. 6c, the objects of interest are enhanced and the background Is filtered. 

For Improving the comfort of the clinfclan during the intervention, the tocallzers may be 
temporally registered during the visualization of the Image sequence with respect to the frame of the 
Image, by matching corresponding localizers of a current Image and of an Image of reference in the 
sequence of Images. The localizer reglshraUon allows further registering the objects of interest, which 
25 pracUcally do not move with respect to the localizers. Thus, the object of interest may be zoomed, as 
shown In Rg. 6c, without said object shifbng out of the image frame. Also, temporal filtering means 
may be used in combination with the means of the Invention to further Improve the images of the 
sequence. 

Said image lo, said marker coordinates (k, Lz) and said inter-maricer line IML are 
30 then processed by the border detection sub-means 60, presented Fig. 3. Said border 
detecOon sub-means 60 aim at deriving the borders of the object of Interest from the 
knowledge of localizer's location (U, U). In the prefened embodiment of the Invention, this 
may for Instance be carried out by an active contour technique (also called 'snake"). This 
technique, well known to those skilled In the art, first consists in defining an Initial contour 
35 and second in making said Initial contour evolve under the influence of Internal and external 
forces. To this end said bortler detection sub-means 60 comprise Initialization sub-means 61 
and active contour sub-means 62, as shown In Rg. 3. 
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As shown in Rg. 7a, said Initialization sub-means 61 may use the marker locations 
(U, L2) to derlye an elliptic Initial contour HC defined by a major axis MA equal to a 
distance between markers U and U and called an Inter-marker distance IMD and a minor 
axis mA equal to a percentage of said inter-marker distance II^D. 

5 If the artery Is curved, it may be more realistic, as shown in Rg. 7b, to take as an 

Initial contour a contour RIC of a rubber band RB having the inter-marker line as a medial 
axis. Said Initial contour HC or RIC Is then used as a starting position for an acHve contour 
AC, shown Hg- 8a, which Is deformed by said active contour sub-means 62. A dynamic of 
the active contour AC Is given by a law of motion. The deformation of said active contour 

10 AC implies two types of forces, which are applied at each point of the active contour AC on 
a normal to said contour: 

- external forces Fg , that constraint tiie active contour AC to get stick to the borders of 
the object of Interest. They are for Instance related to the above-calculated ridgeness of 

the stent borders. A sti-ength of said external force Is detennlned by the highest 

-> 

15 ridgeness encountered on the nomoal iV to tiie active contour AC at a given point P, 

- Internal forces represent regularizaOon forces, that constraint the active contour AC 
to be smooth. They are usually based on curvature constraints. 

It is to be noted tiiat the Inter-marker line IML has a non-negligible ridgeness due to the 
20 guide-wire contrast Said ridgeness may cause parasitic external forces that have tx> be 

annihilated, in order to prevent the active contour to be attracted by said inter-marker line 
IML. This Is done easily since the location of said inter-marker line Is well known. 

When said external and internal forces counterbalance each other, said active contour 
AC stops in a final position, which Is the location of the borders BL of the object of Interest, 
25 as shown In Rg. 8b. 

In a second embodiment of the Invention, the viewing system, as shown In Fig. 9, 
furttier comprises enhancement means 70 for enhandng said borders using said location of 
borders BL and delivering an enhanced sequence of Images EIS. Since said location of 
30 borders BL is known, tiie borders of the object of Interest are enhanced very easily. Said 
borders are formed by points that have a gray level value. Said enhancement means 70 
simply consist In Increasing said gray level values so as to make the borders more visible. An 
outstanding enhancement Is obtained and the main issue Is to tune the enhancement so as 
to keep the enhanced sequence of images EIS acceptable for the practitioner. 
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In a third embodiment of the Invention, the viewing system, as shown Fig. 9, further 
comprises measurement means 71 for measuring diaracterlstlcs CM of said object of 
Interest using sakJ location of borders BL An Interesting characteristic measure of a tubular 
object like a stent or an arter/ Is a collection of wldtiis of said ob^ measured at several 
locations along a length of said object, for Instance along said inter-marker line IML for a 
stent or along the tip for a stenosis. Variations of said wldtfis may indkate whettier the 
stenosis has been well reduced or whetiier the stent has been properly expanded. 

It Is to be noted tiiat the Invention Is not limited to width measures. The knowledge 
of the stent or of the artery borders also enables to derive for Instance an estimation of an 
agent contrast flow In the stenosis area, by measuring the mean contrast of contiguous 
sections of the artery at different times. 

In a fourtti embodiment of the invention, the viewing system, as shown Rg. 9, 
further comprises 3D representation means 72 for delivering a three dimensional (or 3D) 
representation SDR of said object of Interest using said location of borders BL Such a 3D 
representation of a tubular object of Interest like an artery or a stent Is easily obtained from 
two views (lo, lo), which are preferably ortiiogonal views of said tubular object It Is not an 
issue in the domain of angiography, where an X-ray C-anm medfcal examination apparatus 
may provide two views In directions perpendkxilar to the axis of the tubular ol^Ject and 
perpendicular between each otfier. It Is also to be noted ttiat very few distortion Is 
Introduced since the patient Is placed at tiie center of tine medical examination apparatus. 

The localizers (U L2, L'l, L'2) detected In each sequence of Images are matched 
together and define a 3D referential In which all tfie points of tiie borders of the object of 
Interest may be positioned in 3D. It is ttien possible to get 3D measurements of tiie object 
of Interest and 3D visualizations. In part:icular, If the geometiy of tiie object of interest Is 
known or if a 3D model is available, it is possible to fit said model to ttie border points and 
object characteristics so as to get a realistic 3D viewing of the object of Interest. In the 
domain of angiography, a 3D model like a cylindrical shape witii a circular or an elliptical 
section may be used for a 3D representation of a stent or an artery, as shown in Fig. 10. 
Said 3D representation may permit to get Infomiation about the stent placement or the 
stent bending for Instance. 

Rg.ll shows tiie ba^ components of an embodiment of an Image viewing system 
150 in accordance to the present invention. Incorporated In a medical examination 
apparatus. As Indicated schematically in Rg. 11, said medical examination apparatus has 
acquisition means 151 for acquiring a sequence of Images IS. Said sequence of images IS Is 
proc^sed by a processing device 153 comprising detection means as described above. The 
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Image viewing system 150 Is generally used In the Intervention room or near the 
Intervention room for processing real time Images. Should steps of the present method be 
applied on stored medical Images, for example for estimating medical parameters, the 
system for processing the data of the stored Images would be called Image viewing station. 

5 The medical examination apparatus provides the Image data IS by connection 157 to the 
processing device 153. Said processing system 153 provides processed image data to 
display and/or storage means. The display means 154 may be a screen. The storage means 
may be a memory MEM of the processing system 153. Said storage means may be 
alternately external storage means. This processing device 153 may comprise a suitably 

10 programmed computer, or a special purpose processor having circuit means such as LUTs, 
Memories, Filters, Logic Operators, that are arranged to perform the functions of the 
method steps according to the Invention. The image viewing system 150 may also comprise 
a keyboard 155 and a mouse 156. Icons may be provided on the screen to be activated by 
mouse-clicks, or special pushbuttons may be provided on the system, to constitute control 

15 means 158 for the user to start, to confrol the duration or to stop the processing means of 
the system at chosen phases. 

The present Invention Is applicable regardless of the medical Imaging technology 
that is used to generate the Initial data. Various modifications can be made to the order in 

20 which processing steps are perfonned in the above-described specific embodiment. The 
above-described processing steps applied to medical image data can advantageously be 
combined with various other known processing/visualization techniques. 

The drawings and their desaiptlon hereinbefore illustrate rather than limit the 
invention. It will be evident that there are numerous alternatives, which fall within the scope 

25 of the appended daims. In this respect the following closing remarits are made: 

There are numerous ways of Implementing functions by means of Items of hardware or 
software, or both. In this respect, the drawings are very diagrammatic, each representing 
only one possible embodiment of the Invention. Thus, although a drawing shows different 
funcUons as different blocks, this by no means excludes that a single Item of hardware or 

30 software can-les out several functtons, nor does It exclude that a single funcBon Is carried 
out by an assembly of Items of hardware or software, or both. 

Any reference sign In a dalm should not be consbxied as limiting the dalm. Use of the 
verb ^to comprise" and Its conjugations does not exdude the presence of elements or steps 
other than those stated In a dalm. Use of the artlde '^a" or "an" preceding an element or 

35 step does not exclude the presence of a plurality of such elements or steps. 
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CLAIMS 

1. A viewing system (150), comprising acquisition means (151) for acquiring a 
sequence of Images (IS), detection means (20) for detecting an object of Interest 

5 (2, 17) In said sequence of images (IS), 

said detection means (20) compiling: 

- localizer detection sui>means (30) for detecting a location (U, U) of 
localizers related to said object of Interest, 

- border detecOon sub-means (60) for detecting a location of borders (BL) 
10 related to said object of interest, using said location of localizers, 

and viewing means (154) for displaying said sequence of Images (IS). 

2. A viewing system (150) as claimed In claim 1, wherein said border detection sub- 
means (60) comprise: 

15 - Initialization sub-means (61) for building an Initial contour (EIC, RIC) of said 

borders containing said localizers (U, La), from a priori knowledge about 
said object of Interest, 

- Active contour sub-means (62) for moving said Initial contour (BC, RIC) 
under the effect of forces related to raid object of Interest (2, 17) within 

20 said sequence of images (IS). 

3. A viewing system (150) as claimed In claim 1 or 2, comprising enhancement means 

(70) for enhancing said borders using said location of borders (BL) and delivering an 
enhanced sequence of images (EIS). 

25 

4. A viewing system (150) as claimed in claim 1 or 2, comprising measurement means 

(71) for measuring characteristics (CM) of said object of Interest using said location 
of borders (BL). 

30 5. A viewing system (150) as claimed In claim 4, wherein said characteristics (CM) are 
widths of said object of Interest along a length of said object of Interest. 

6. A viewing system as claimed In claim 1 or 2, wherein said acquisition means (151) 
are able to acquire at least two views of said object of Interest;, said viewing system 
35 furttier comprising 3D representation means (72) for delivering a 3D representation 

(3DR) of said object of Interest from said views and said location of borders (BL). 
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A viewing system as claimed In dalm 6, wherein a cyllndiical model Is used by said 
3D representation means (72), when said object of Interest has a tubular shape. 

A viewing system as claimed In one of claims 1 to 7, wherein said object of Interest 
is a stenosis (2) or a stent (17) and said localizers are a tip (9) or balloon markers 
(13, 14). 

A method, comprising a detection step (20) for detecting an object of Interest In a 
sequence of Images (IS), said detection step comprising sub-steps of: 

- localizer detection (30) for detecting a location of localizers (U U) related 
to said object of Interest, 

- border detection (60) for detecting a location of borders (BL) related to said 
object of interest, using said location of localizers. 

A device (153) comprising detection means (20) for detecting an object of Interest 
In a sequence of Images (IS), said detection means comprising: 

- Localizer detecHon sub-means (30) for detecting a location of locaHzers 
related to said object of interest, 

_ Boixler detecdon sub-means (60) for detecting a location of bordas (BL) 
related to said oliject of Interest, using said location of localizers. 

A computer program comprising a set of instructions for implementing a method as 
claimed In claim 9, when said program Is executed by a processor. 

A medical examination imaging apparatus comprising a viewing system (150) as 
claimed In one of dalms 1 to 8. 
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"MEDICAL VIEWING SYSTEM AND METHOD FOR DETECTING BORDERS OF AN OB3ECT OF 
INTEREST IN NOISY IMAGES " 

Abstract 

The Invention relates to a viewing system and a nfiethod for detecdng an object of 
interest In a sequence of Images (IS). Said object of Interest Is detected by first locating 
localizers related to said object of Interest and by further locating borders (BL) related to 
said object of Interest using the location (U, L2) of said localizers. 

The viewing system according to the invention enables to perform an outstanding 
enhancement, measure some characteristics and build a three dimensional representation of 
said object of interest 
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FIG. 2a 
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FIG. 3 
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FIG. 9 
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